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1. Introduction 

Equilibrium statistical physics provides the microscopic foundation of thermodynamics, 
built around the concept of entropy as the logarithm of the phase volume. The theory 
has been extended to the regime of linear irreversible thermodynamics by identifying 
the entropy production in the regime of linear response [TJ, EJ, El S] • There exists to 
date no general theory covering the far from equilibrium situations. However, recent 



results known as fluctuation El [3 El [9] or work pm dH d2l H31 OH H51 USl 031 HB] 



theorems point to the existence of exact equalities valid independent of the distance 
from equilibrium. These equalities involve fluctuations in work or entropy production. 
For the average of these quantities, they reduce to inequalities, in agreement with 
the second law of thermodynamics. For example, the Jarzynski equality states that 
(exp(— PW)) = exp(— /3AF), where W is the work needed to bring a system, in contact 
with a heat bath at temperature T {f3~ l = fcgT), from one initial state prepared in 
equilibrium to another one and AF is the difference in free energy of these states (see 
[TJ] for a more precise discussion). By the application of Jensen's inequality, one finds 



While the work and fluctuation theorems are certainly intriguing results of specific 
interest for the study of small systems, they provide no extra information on the average 
value of work and entropy production. Recently however, the microscopically exact 
value of the average work has been obtained in a set-up similar to that of the work 
theorem [19]. The system is described by a Hamiltonian H(T, A), where T = ({q}, {p}) 
is a point in phase space, representing all position and momentum variables, and A 
is an external control parameter (for example the volume or an external field). The 
system is perturbed away from its initial canonical equilibrium by changing the control 
parameter according to a specific schedule, from an initial to a final value. This involves 
a certain amount of work W, which is a random variable due to the randomness of the 
initial state. By repeating the experiment (or by solving Liouville's equation) one can, 
in principle, evaluate the probability density p(T; t) for the system to be in a specific 
micro-state T at a specific (but otherwise arbitrary) intermediate time t during the 
transition. Furthermore one considers the time-reversed scenario, in which the system 
starts in canonical equilibrium at the final value of the control parameter, and the latter 
is changed following the time-reversed schedule. We will use the superscript "tilde" 
to refer to such time-reversed corresponding quantities. Then one measures the phase 
space density p(T; t), at the moment when the control parameter reaches the same value 
as the one considered in the forward experiment (so t here stands for the forward time 
and T = ({q}, { — p}). The dissipated work (W) — AF, which is the "unknown positive 
quantity" appearing in the second law, is then found to be given by the following explicit 
result: 



D(p\\p) is the relative entropy, also called Kullback-Leibler distance [20] • It is a 



(W) > AF. 




(1) 
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positive quantity, in agreement with the second law. While the above result is exact 
and fully reveals the microscopic nature of the dissipation, it may appear to be of little 
practical interest. Indeed, it requires full statistical information on all the microscopic 
degrees of freedom of the system (even though only at one particular time). This 
stringent requirement is obviously on par with the generality of the above result, which 
is valid however far the system is perturbed away from equilibrium. The perturbation 
could therefore imprint its effect on all the degrees of freedom and their full statistical 
information would be required to reproduce the corresponding dissipation. 

One main purpose of this paper is to tune the above result to situations in which 
only a limited number of degrees of freedom are either relevant or available. An 
important class of such systems, notable for its accurate description of mesoscopic 
phenomena in physics, chemistry and biology, are stochastic models such as the Master 
Equation or the Langevin equation [21] . The application of Eq. (TjQ) to systems described 
by stochastic dynamics is not obvious. Instead, we will derive in the next section 
a general and exact result applicable to stochastic systems by rewriting Eq. (1) in an 
alternative form, as an integral over paths. A simple argument to derive this formulation 
for Hamiltonian dynamics goes as follows. 

Since the microscopic dynamics is completely deterministic, the specification of an 
elementary phase space volume dT around the position T at time t is equivalent to 
the identification of an elementary ensemble of paths D(path) surrounding the phase 
space trajectory going through T at time t. The probability to select a path inside this 
bundle (of constant cross section, dT being preserved following Liouville's theorem) will 
be denoted by 'D(path)7 :, (path), where P(path) is the probability density in function 
space. Similarly, one defines the density P(path) for the time-reversed schedule. In Sec. 
2 we will prove that Eq. ([!]) can be rewritten as follows: 



The above expression is in principle valid only if "path" stands for the microscopic 
(and hence deterministic) trajectory of the system, including information about every 
degree of freedom. If only partial information about this trajectory is taken into 
account, the relative entropy is typically reduced and one cannot derive an equality 
for the dissipation, but just a lower bound. However, we will show in the next section 
that in the path description, not all variables are always needed. This will be a 
welcome simplification since a detailed description of the microstate of the system is 
rarely available, especially if the system contains many "thermal degrees" of freedom. 
Furthermore, we will also focus on the case of missing information, both at the level of 
the path and at the level of variables. In this case one can produce lower bounds for the 
dissipation. This issue has been briefly discussed in the incipient letter [19], but will be 
addressed here in greater detail and broader generality. 

The layout of this paper is as follows. We first prove in Sec. [2j that Eq. ([2]) 




A; B T J D(P(path)||P(path)). 



(2) 
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is also valid, as an equality, for stochastic dynamics and discuss the relation between 
this result and Crooks' theorem. We next investigate in a number of experimentally 
relevant examples, how relative entropy, and consequently the estimated dissipation, 
decreases when only partial or coarse grained information on the system is taken into 
account. Such coarse-graining can be applied to the measurement in time, or to the 
choice of variables. We will present illustrations for both cases. First we calculate in 
Sec. [3] the lower bound for dissipation upon coarse graining in time for an overdamped 
Brownian particle in a time- dependent moving harmonic potential [22], [23]. We discuss 
the convergence to the exact dissipation as the number of measurement points of the 
stochastic trajectory increases. Next we turn in Sec. H] to an underdamped Brownian 
particle in a harmonic potential. We illustrate how the information about the dissipated 
work involved in quenching the potential oscillates, in a single time measurement, 
between position and momentum variables and eventually is irreversibly lost into the 
heat bath variables. Finally, we consider in Sec. [5] a Brownian particle in a quenched 
harmonic potential in contact to a heat bath via a second Brownian particle. The 
information about the dissipation is then found to channel back and forth between the 
4 degrees of freedom, position and momentum of both particles, in a very intricate and 
intriguing way. 

2. Dissipation in stochastic dynamics 

The derivation (for stochastic models), interpretation and application of the main result 
Eq. (T5]) heavily relies on two basic properties of the relative entropy, namely Stein's 
lemma and the chain rule [20J, which we now review. 

Stein's lemma gives a more precise operational meaning to the relative entropy. The 
relative entropy D(p\\q) between two different distributions p(x) and q(x) quantizes 
the likeliness for independent samplings from p(x) to be statistically identified as 
samplings from q(x). More precisely, Stein's lemma states that the chance for mistakenly 
attributing a series of n samplings fromp(x) to q{x) decreases (at best) exponentially as 
e -nD{p\\q)^ Yience, the identification of the statistical source becomes exponentially more 
difficult when the relative entropy decreases. Note that the relative entropy is not a 
symmetric function of its arguments. This is consistent with the fact that the difficulty 
to distinguish p from q depends on whether the samplings come from p or q. 

As applied to our basic result, Eq. (pQ) or we conclude that the dissipated 
work is essentially related to the difficulty for distinguishing the arrow of time: the 
dissipated work will be small (or large) in the forward experiment, when realizations of 
that process can be easily (or hardly) confused with those appearing in the backward 
process. Typically, the dissipated work is extensively large for macroscopic systems 
when operating away from the quasi-static regime, and the arrow of time is clearly 
apparent. Close to the quasi-static regime with small dissipation, the system is near 
equilibrium at each instant of time and both snapshots and runs in the forward or 
backward experiments will look very much alike. When operating away from the quasi- 



Bounding dissipation in stochastic models 



5 



static regime in sufficiently small systems, it may still take several runs to clearly 
statistically distinguish forward from backward runs. The dissipated work is clearly 
positive but may be small or comparable to ksT. 

Next we turn to the chain rule. Consider two random variables X and Y . The 
relative entropy between two different distributions p(x, y) and q(x, y) can be written as 

p(x,y) 

q(x,y) 
p(y\x)p(x) 



D(p(x,y)\\q(x,y)) = / dx dyp(x, y) In 

dx dyp(x, y) In 



q(y\x)q(x) 

dxp(x) j dyp{y\x) In , . , (3) 

a result referred to as the chain rule for the relative entropy. Since the last term in the 
r.h.s is non-negative, one concludes 

D (j)(x, y) \\q{x, y))>D (p(x) \\q{x)) . (4) 

This inequality has a simple intuitive explanation. The relative entropy is a measure 
of the distinguishability of the two probability distributions. It is obvious that the 
distinction will be easier to make when considering the statistical information of the 
two variables rather than only one of them. Next, we mention the following special 
cases of the chain rule. If X and Y are independent, we have 

D (p(x, y) \\q{x, y)) = D (p(x) \\q(x)) + D (p(y) \\q{y)) , (5) 

However, note that, in general, the sum of D (p(x)\\q(x)) and D (p(y)\\q(y)) can be 
either bigger or smaller than D (p(x, y)\\q{x, y)). 

If X = f(Y), f being a one-to-one function, then one of the variables does not add 
any information about the other one, hence 

D (p(x, y) \\q{x, y)) = D (p(x) \\q(x)) = D (p(y) \\q(y)) . (6) 

This last observation — that the addition of variables which are functions of the 
existing ones, leaves the relative entropy invariant — provides a rigorous derivation of 
Eq. ([2]) from Eq. ([1]) for Hamiltonian dynamics. Indeed, since Hamiltonian dynamics is 
purely deterministic, one can specify, without changing the value of the relative entropy, 
the micro-state Tj of the system at as many additional measurement points in time ti, 
i = 1, ...,n, as one likes in Eq. ([T|): 

(W) - AF = k B T f ft dT t p({r,; U}) In ^ ^ ■ (7) 

In the continuum limit covering the entire time interval (with n — > oo), one thus 
converges to the path integral formulation given in Eq. (T5]). This expression, while 
containing redundant information from the point of view of Hamiltonian dynamics, has 
the important advantage (see below) that it is also exact and formally identical (i.e., 
the path is now in terms of the reduced set of stochastic variables) in its application to 
stochastic systems. Furthermore, in the latter case, the path formulation is no longer 
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redundant since the trajectory captures information about the eliminated degrees of 
freedom. 

The straightforward application of the chain rule in Eq. ([TJ) or (J2J) now leads to the 
following result: 

(W)-AF>k B TD(V(x)\\V(x)), (8) 

where x is any partial information on the path followed by the system with corresponding 
probability V(x). The variables x can reflect a reduction in the number of variables, a 
measurement of these variables in a coarse grained fashion, or the reduction to partial 
or even punctual information in time along the path. The above formula is quite useful, 
since it improves on the second law statement (W) —AF > 0, with whatever information 
is available. Furthermore, the formula in principle allows one to identify which are the 
relevant variables or degrees of freedom whose time symmetry breaking is the most 
relevant to estimate the dissipation. The following sections will be devoted to illustrate 
these issues in detail on several explicit examples. 

The chain rule also reveals a most interesting relation between the probabilities 
for paths and probabilities for work by comparing the general result for the average 
dissipation Eq. ([1]) or ([2]) with the Crooks theorem. The latter has been proved for 
both stochastic [24j and Hamiltonian systems [H] and states that: 

k B T\n P ^ =W - AF, (9) 
P(-W) 

where P(W) and P(W) are the probability distributions for the work in the forward 
and the backward process, respectively. From this theorem, one immediately obtains 
the following expression for the average dissipation: 

(W) — AF = k B TD(P(W)\\P(—W)). (10) 

By comparison with Eq. (J2J), we conclude that 

D(P(path)||P(paTh)) = D(P(W)\\P(-W)). (11) 

Crooks theorem thus implies that the time asymmetry in the probability distribution of 
the work fully determines the average dissipation. This is a surprising relationship with 
important consequences. From the chain rule for the relative entropy one would expect 
that the relative entropy for the paths, which contains all the information on the process 
under consideration, would be bigger than that contained in a single variable, namely 
the work. However, the two relative entropies are equal, indicating that the statistical 
information about the work in the forward and backward processes accounts for every 
appearance of the arrow of time. 

The foregoing intriguing conclusion can be turned around to provide a general 
derivation of Eq. (j2j), as applied to stochastic processes. Indeed, the work obviously 
depends only on the dynamic variables that are interacting with the external device 
during the process. Hence it is enough to know the (statistical) behavior of these 
variables to reproduce the statistics of the work, and hence the average dissipation. In 
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principle, this even needs not be all the variables, but only those that matter for the 
energy exchange. In that case, trajectory information of these and only these variables, 
along the whole (both forward and the backward) process, is enough to account for 
the total average dissipation. In particular, if a stochastic model provides the exact 
description of a system in its interaction with an external device, one needs only the 
path information of these variables. Eq. (jSJ) is thus valid for the stochastic model with 
the path determined in terms of the corresponding stochastic variables. As a corollary, 
we note that bath variables which are replaced (in some ideal limit) by a stochastic 
perturbation, will not appear in the "path" , which is in terms of the trajectory of the 
stochastic system only. 

The above argument forms an alternative derivation for stochastic models, 
complementing a more standard proof which runs as follows. We distinguish, in the 
path integral of Eq. (j2J) involving all microscopic variables, the integration over fast 
microscopic variables and the relevant mesoscopic stochastic variables. The idea is 
that the microscopic variables can be integrated out, leaving a path integral over the 
stochastic variables only. This will be the case if the dependence on the micro- variables 
disappears under logarithm in the ratio of the probability of a path and its time-reverse. 
They can then be further integrated out, leaving only stochastic variables. The usual 
scenario implies a limit involving a separation of time scales: the micro- variables assume 
instantaneously an equilibrium distribution (which is the same in both forward and 
backward process and hence drops out) for the given values of the slow stochastic 
variables. Being all the time at the instantaneous equilibrium implies that they do 
not carry any time-asymmetry and thus, not surprisingly, do not contribute to the 
dissipation. Notice however that our first derivation, based on Eq. ( fTTT) . indicates that 
the separation of the two time scales may not be necessary, since only the variables that 
determine the work will be required. In particular this derivation puts no limitation 
on the nature of the stochastic process, other than that it be consistent with (derivable 
from) the microscopic dynamics. In particular, the process does not have to be Gaussian 
nor Markovian. 

We need to make some additional remarks on the interpretation of Eq. (j2J) for 
stochastic processes. First, we have to recall that, in the derivation of the above result, it 
is assumed that the system starts in canonical equilibrium in both forward and backward 
scenario. Hence the integral over the paths, whether microscopic or stochastic, has to 
be performed over initial canonical distributions. Second, we note that in the switch 
to a stochastic process, we need to consider the distribution of paths during the entire 
duration of the experiment. Only for Hamiltonian dynamics does the phase space density 
and one particular instant of time carry all the information on the dissipation during the 
entire experiment. Notice also that the general bound jSJ), for an arbitrary description 
of the system given by the set of variables x, does not follow from Crooks theorem. 
We do need the microscopic results Eqs. ([I]) or (j2J) to conclude that any "additional" 
information contained in x does not lead to an increase of the relative entropy. In other 
words, an overestimation of the dissipation via the relative entropy is excluded. 
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We finally put Eq. (j2J) in the context of various results from the literature. The 
importance of relative entropy in nonequilibrium statistical mechanics has been the 
object of general discussions, both in the context of classical Hamiltonian mechanics 
[26] and quantum mechanics [27]. A result for the average work is also derived in |28j, 
but the focus of such paper is on the interpretation of the Jarzynski equality, and the 
connection with the relative entropy (and with its extremely useful properties) is not 
made. The above expression ([2]) for the mean dissipation is consistent with earlier results 
for Markovian dynamics [29]. More recently, arguments have been produced to show 
that 

fcB ln« (12) 
P(path) 

is the correct expression for the path dependent entropy production in Markovian 
stochastic systems [30, [311 [321 [331 [M] , see especially the early works by Maes [9] and by 
Crooks [2U[25j. The connection with Eq. ([2]) is made by observing that the dissipated 
work is evacuated to the heat bath as heat so that Eq. is equal to average entropy 
production divided by the temperature. Note that the average entropy production is 
always positive, while the path dependent expression can have any sign. More recent 
discussions include general arguments based on coarse graining [33] , Langevin equations 
[35J, stationary stochastic processes [36], and an experimental verification for dragged 
Brownian particles [23J . A similar formula has also been proposed for dynamical systems 
[37] , to characterize the time asymmetry of the Sinai- Kolmogorov entropy. 



3. Overdamped Brownian particle: coarse graining in time 

Referring to Eq. ([2]) and our preceding discussion concerning the variables that need to 
be included in the path integral, it would be welcome to have a simple explicit example 
in which all the calculations can be done analytically. In this section we present such 
a case which is moreover of experimental relevance, namely the case of an overdamped 
Brownian particle subject to a moving time-dependent harmonic potential: 

V(x,t) = ^(x-ut) 2 . (13) 

This same example will also provide a simple illustration of the chain rule as applied to 
coarse graining in time. 

3.1. Stochastic energetics for a Langevin equation with time dependent potential 

The time evolution of the position variable x of the overdamped particle obeys the 
following Langevin equation 

x = -d x V{x,t)+({t). (14) 

£(t) is a Gaussian white noise, with (£(t)£(t')) = 2T5(t — t'). For simplicity of notation, 
we have absorbed the friction coefficient in the time unit and the Boltzmann constant ks 
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in the definition of temperature. Before proceeding to the relation between dissipation 
and relative entropy, we review the salient features of the energy balance. 

Our starting point is conservation of total energy during an experiment from initial 
time to to final time tf. Since the particle is instantaneously thermalized at the constant 
temperature T of the heat bath, its change in energy is equal to its change in potential 
energy AV = V(xf,tf) — V(x ,t ). The latter must be equal to the amount of work 
W exerted by the external force (sometimes called the injected work) minus the heat Q 
delivered to the heat bath (also referred to as dissipated heat to the environment) 

AV = [ tf ^dt = f f ^dt + [ tf ^xdt = W-Q. (15) 
Jt dt Jt at Jt ox 

From such energy balance (or first law at the level of stochastic quantities), the 

fluctuating heat and work can be identified [30] ; the rate of heat dissipated to the 

heat bath is given by Q = —d x Vx, while the work done per unit time in moving the 

external potential is W = dtV. These quantities depend on the actual realization of 

the stochastic trajectory x(t). Thus heat and work are random variables. The fact 

that injected work and dissipated heat differ by the energy stored in the particle has 

important consequences for their large deviation properties for asymptotically large 

times when the latter energy is unbounded. The fluctuation theorem has therefore to 

be carefully reconsidered [3HI EHJ EH SH H2J \M> EH] • 

We will be concerned here with the average work, in which case large deviation 

issues are irrelevant. Using the explicit expression of the potential ( TL3l) . one finds 

rh dV{x,t), \ I [tf 



w= u't* )=</;**<* -*>ho) 




dt(x(t) - {(*)) = «[«(/)) - (z(to))]. (16) 

On the other hand, the average of equation (1H1) yields the following exact closed 
equation for the average position 

(x) = -(d x V} = -k((x}-ut). (17) 

The solution reads: 

(x(t f )) = e- k{t f- to) (x(t )} + j[kt f - 1 - e- k{t f~ t0 \kt - 1)]. (18) 

We take the initial time to = 0. Then, since the system must be prepared initially in 
equilibrium, from the evolution equation it is obvious that (a; (to)) = 0. 

The translation of the harmonic potential minimum does not change the free energy 
of the system, AF = 0. We then obtain that the dissipated work, being exactly equal 
to average work, is given by 

v 2 

(W dlss ) = (W) - AF = -{kt f + e~ kt f - 1). (19) 

In the sequel, we will illustrate how this result is approached from below as we obtain 
more the information on the paths by an increasing number of measurements in time. 
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M=t//n 




t//3 2t//3 tf itf/n tf 



Figure 1. Sketch of the n-slicing procedure in which the full trajectory of the particle 
is not measured but only its position after time intervals of duration At = tf/n, where 
tf is the total time of the experiment. 



3.2. Coarse- graining in time 

It is obviously impossible to numerically or experimentally measure with infinite 
precision the full trajectory of a particle. Instead, its position x(t) can be recorded 
at a finite number of measurement points in time. This information loss about the path 
can be viewed as a coarse-graining (in time). By replacing the path integral by the 
corresponding finite sum, one finds an approximate value for the dissipation. However, 
as mentioned before, one gets more: this result, and in fact any result obtained through 
coarse-graining, constitutes a rigorous lower bound. The calculation which we are about 
to perform will tell us how fast this bound converges to the exact value. 

For simplicity we will consider that the coarse graining is into n equal divisions 
At = tf/n of the total time duration tf. Therefore, in this n-slicing procedure, the 
full trajectory of the particle is not measured but only its position after time intervals 
of duration At. See figure ([1]). The probability for a discretized path can be easily 
evaluated since the process is Markovian and Gaussian. Let us denote by p(xi+i\xi) the 
conditional probability for jumping from a point Xj at time tj to a point Xi + \ at time 
ti + At, and let p^ 9 be the initial equilibrium distribution. The probability V of the 
n-sliced discretized path x = [xq, x\, X{, Xf] is then given by 

n-l 

V{x) = V{[x , x 1 , Xi, x n _i, x f ]) =p e q (x ) Y[p(x i+1 \xi). (20) 

i=0 

An analogous expression is valid for the backward path and probability, with superscript 
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"tilde" again referring to time reversed excursion. The central quantity to evaluate is the 
following coarse-grained relative entropy (multiplied by T, since we want to compare 
with the dissipated work, and having absorbed ks in its units): 



I n = TD(V(x)\\V(x))^T(\n 



PoVo) \ + T A n \ Xi 



i=0 



p(xi\x 



(21) 



Pf( x f). 

The brackets (...) refer to the average performed with the forward distribution V. 

The next step is to find the general expression for p(xi + i\xi) and p(xi\xi + \). Since 
the Langevin equation that describes the dynamics is linear, the conditional probabilities 
are Gaussian distributions 



p(x i+ i\xi) 



1 



V2 



: exp 



and 



p(xi\x 



i+i/ 



V2 



: exp 



7T(J Z 



2a 2 
2o 2 



(22) 



(23) 



From equation ( {TBI) (applied for final and initial times tj+i and ti, respectively, and 
with the appropriate initial condition) the conditional averages are found to be 

(x i+ i) Xi = Xie~ kAt + u + r]ti (24) 



and 



where 



{ X i)x i+1 



- U ( 



x i+1 e kAt - u + i] t i+ i 



-kAt 



+ kAt-i), r) = u(l-e 



-kAt\ 



(25) 



(26) 



Similarly, one can multiply the Langevin equation by the position x and then take 
averages. This leads to the following equation for the variance a 2 = (x 2 ) — (x) 2 : 
1 d o 



-—a 

2dt 



-ka 2 + T, 



which yields (conditional variances starting at zero value) 



a' 



T, 

i' 1 



-2kAt\ 



(27) 



(28) 



for both (forward and backward) cases. 

In order to obtain J n , we insert the above conditional probability distributions 
in Eq. fT2Tl) . work out the squares and arrange the averages. The final result can most 
revealingly be written in terms of the duration of the experiment tf and the final position 
z = utf. After some algebra, one finally gets 



-kt f 



(2n + 1) + (1 - kt f )e- kt f V + (2n - 1 + kt fe - kt f)e^f 



kt f 1 + en 

We also mention explicitly the results for n = 1 and n = 2: 

2 



kt) 



'kt s _^ e kt f 

1 + e kt f 



(29) 



(30) 
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(a) (b) 




Figure 2. (a) Plot of /„ (for n = 1,2,3,4 and 1^ = (Wdiss)), as a function of the 
ratio of characteristic times ktf. We have scaled out the prefactor fczp. Note that 
I n is always a lower bound to (Wdiss) and converges to the irreversible instantaneous 
quench value (dashed line) and to the quasi-static limit (zero value) for ktf — > and 
ktj — > oo, respectively. Inset: the relative error R n = ((Wdiss) — In) / (Wdiss) increases 
as a function of ktf. (b) Plot of I n (for different values of ktf) as a function of the 
number of time divisions n of the trajectory. 



and 



kt -p kt -p 

kt f + e~2 + 3e 2 - 5 



1 + e 2 

First note that in the limit n — > oo one finds (cf. Eq. (1191) ' 



/oo = -rL(ktf + e~ kt f - 1) = (Wtf M >. (32) 

Hence the exact dissipation is, as anticipated, recovered in the limit of the continuous 
path description. Using the same procedure, one can show that this result remains valid 
for a general time dependent potential (see the Appendix). 

We now turn to the main question of interest here. How is the convergence of I n 
to (Wdiss)7 First, one can verify that, for any value of the system's parameters, I n is 
always a lower bound for the total dissipation: 

(W) >I n >0. (33) 

Next, as is apparent from the explicit result, the convergence of I n to (Wdiss) depends 
only on the ratio of the time of the experiment tf over the relaxation time 1/k in the 
harmonic potential. In figure ([2ja) we plot I\ up to I4, as a function of ktf. The 
convergence is surprisingly good. For example, for ktf = 1, the error in I2 (single 
intermediate measurement point, plus the initial and the final points, which are always 
measured) is only a few percent. We also study in figure ([2jb) the evolution of J n , 
for different values of ktf, as the number of measured points increases. Note that the 
biggest jumps in I n occur from n = 1 to n = 2, after which the bound quickly saturates 
and slowly approaches the total mean dissipated work. 
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In the limit u — > or kt / — > oo (very slow translation of the potential), one recovers 
the quasi-static result of zero dissipated work. Note however that the relative rate of 
convergence becomes quite bad in this limit (cf. inset in figure (121 a)). On the other 
hand, the fit is perfect in the limit of the irreversible quench, in which the potential is 
instantaneously switched to its new position. This corresponds to the limit u —>■ oo or 
ktf — ► 0. One finds 

In(t f ^0) = (W diss )(t f ^0) = hz 2 Vn. (34) 

The dissipated work is exactly equal to the average work done in instantaneously placing 
the particle in the shifted potential. 

4. Underdamped Brownian particle: coarse graining in the space of 
variables 

According to Eq. (jTJ), the average dissipated work is obtained from a single time 
measurement of forward and backward statistics of the full system. Eq. ([2]) provides 
a complimentary result, since the measurement of some (e.g. heat bath) variables 
can be avoided and the average dissipated work is still obtained if the reduced set of 
stochastic variables are measured along the whole time track of the experiment. In the 
previous section, we discussed the effect of coarse graining in time for the measurement 
of the single relevant variable at hand, namely the position of the overdamped Brownian 
particle. In this section, we address the additional question about the role of specific 
variables (or degrees of freedom) in revealing the dissipation. 

We naturally turn for the illustration of this point to underdamped Brownian 
particles in a harmonic potential since both position and momentum of the particle are 
relevant. Instead of considering a moving harmonic potential with fixed strength, we 
turn to another experimentally significant scenario of a non-moving harmonic potential 
undergoing an instantaneous quench, say at the initial time t = from a frequency Uq 
to the frequency lo\. 

The point in phase space of all degrees of freedom, denoted previously by T, and 
which includes all the bath variables, is supposed not to be accessible. As available 
statistical information we consider the probability distribution for position x and 
momentum p at a single arbitrary instant of time t after the quench. Then, statistical 
information on this reduced set of variables at just one particular time must provide 
again lower bound for the dissipated work corresponding to such quench: 

(W diss ) > TD(p(x,p;t)\\p(x,-p;t)). (35) 

Below we will elucidate the effect of coarse graining implied in the punctual measurement 
in time (at time t) and, moreover, on a reduction in the number of variables (measuring 
only x, only p or both). Note that we are free to decide what we call the final time 
of the experiment, hence the choice of the measurement time after the quench is also 
completely free. 
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4-1. Mean dissipated work 

The average work (Wdiss) dissipated at the moment of the instantaneous quench can 
be evaluated as follows. The potential energy of the particle when at a position x, 
is given by Vi(x) = muj 2 x 2 /2, where uoi is the harmonic frequency with % = and 
i — 1 before and after the quench, respectively. The probability distribution of the 
position at the moment of the quench is given by Po 9 (x) = exp(— V (x)/T)/Z (as before, 
Boltzmann's constant is absorbed in the temperature for simplicity of notation). Here 
Zq, the normalization constant, is the familiar partition function. Averaging with respect 
to this distribution (notation (...)o), we conclude that the average work associated to the 
quench is given by (W) = (Vi(x))o — (Vq(x))q = {T /2){u\/uq — 1). The corresponding 
change in free energy is found to be AF = —TXniZxjZ^) = T\\i{uji/ ujq). Therefore, the 
total dissipation in the irreversible instantaneous quench reads 

(W diss ) = (W) - AF = % ( In 4 + 4 - 1 V ( 36 ) 

Z \ L0 1 LOq ) 

Note that the total dissipated work is always positive due to the irreversible nature of 
the process. 



4-2. Probability density in forward and backward scenario 

To obtain the bound from the coarse-grained relative entropy appearing in the r.h.s. 
of Eq. (1331) . we need to evaluate the probability distributions in forward and backward 
scenario. The derivation for the backward scenario is very simple. The system starts at 
canonical equilibrium with frequency Ui, and the quench is performed at the end of the 
experiment (t = in forward time, which is the final time in the reverse experiment). 
The particle is then at canonical equilibrium with respect to the frequency w\ throughout 
the process, so that 

e ~(p 2 /2m+mu 2 x 2 /2) /T 

p(x, p; t) = pt q (x, p) = ^— . (37) 

Note that the distribution is even in p, namely p(x,p;t) = p(x,—p;t). Hence the 
distribution p is Gaussian with the following moments: 

(x) = (p) = (xp) = 0, 

(i 2 ) = T/imcuf), 

(p 2 ) = mT. (38) 

One the other hand, in the forward scenario, the initial condition is canonical with 
respect to the initial frequency u , p(x,p;0) = pl Q (x,p). At t = the frequency is 
suddenly changed to uo\ and then kept constant along the whole process. Therefore, 
the evolution of the system in the forward process consists of a relaxation to the 
new equilibrium state, pl q (x,p). We write the familiar equations of motion for an 
underdamped Brownian particle for times t > 

p(t) = - muo 2 lX {t) - + (39) 
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(40) 



where A is the friction coefficient, and £ is Gaussian white noise with strength determined 
by the fluctuation dissipation theorem, (£(£)£(£')) = 2AT5(t — £'). The initial condition 
is stipulated by the fact that prior to the quench at t — 0, the system is at equilibrium 
in a harmonic potential with strength ujq, i.e. it is bi-Gaussian with (compare with 
Eq. (EHD) 



(A 
(A 



(x)( t =o) = (p)(*=o) = (xp)(t=o) = 0, 
/;/-.)) = T/(rnw%), 

>(t=o) = mT. (41) 

Since the Langevin equation is linear, the resulting time dependent probability 
distribution p(x,p;t) remains a Gaussian. Therefore, it is sufficient to evaluate the 
ensuing time evolution of first- and second-order moments. Since there is no shift in 
the center position of the harmonic potential, the average position and momentum stay 
equal to zero: (x(t)) = (p(t)) = 0. The second order moments on the other hand obey 
the following evolution equations which following directly from the equations ( l39l) and 
"SB: 

2 



> 2 > 

d 



dt 



(xp) 



■(xp), 
m 

2A 

- 2wjJ{ (xp) (p 2 ) + 2 AT, 

m 

— (p 2 ) — mtofix 2 ) (xp). 

m m 



These have to be solved with the above mentioned initial conditions. One finds: 



(A 



(A 



{xp)t 



where 



T 



mT 
mT 



r 2 



-tX/m 



Try \ 

a 2 /2 - (1 - a 2 /2) cosh[iz/] - yZ/sinh[tz/]J 



a 



a' 



e- tx/m sinh 2 (tu/2) 



LO 



A 1 - (T 2 



-tX/m 



rn 



1 — cosh(tzz) — zzsinh(t^) 

A 



10 



V 



m 



a' 



a 



2miO\ 
A ' 



(42) 

(43) 
(44) 
(45) 

(46) 



Note the switch from a monotonously decay (u real) to an oscillatory one (v imaginary) 
of the above solutions for the moments as a crosses the value 1 from below. 



4-3. Relative entropy 

We are now in position to evaluate the relative entropy (or Kullback-Leibler distance) 
between p(x,p;t) and p(x, — p;t). The relative entropy between the forward and the 
backward distribution can be considered as a distance between p(x,p;t) and its final 
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equilibrium state pl q (x,p), only reached for t — > oo. Since both densities are Gaussian 
(and the backward distribution is even in p), the following simple result is obtained: 



D x , p {t) = D(p(x, p; t) | \p(x, -p; t)) = In 



detC 2 , Tr(C^C 2 ) 
\d^C~ 2 + 2 X > (47) 



where C 2 and C 2 are the covariance matrices of the forward and backward distributions, 
respectively 

C2 -\M t (p 2 )J' (48) 



^<<S S! (49) 



The above result can be further simplified to 




(x 2 )(p 2 ) (x 2 ) t , (p 2 > 



(*W) t - <*p> 2 + <5 2 > + (p 2 ) 7' (50) 

From now on, subindices in D refer to the variables of the probability distributions 
for which the relative entropy is evaluated. We also mention the results for the 
relative entropy of the probability distribution of only the position D(p(x;t)\\p(x;t)) 
and momentum D(p(p; t)\\p(— p; t)): 

D.(t) = ±LgL + %£-l), (51) 




W'^M+w- 1 )- (52) 

With these explicit results (depicted in figure [3]), we can discuss how well the 
various relative entropies capture the dissipation. We first note that at the moment of 
the quench, full information on the dissipation is captured completely in the statistical 
information on the position variable (D x (0) = (Wdiss) /T), while none is available from 
the momentum variable (D p (0) = 0). This is consistent with the observation that the 
position variable is the only variable which is out of equilibrium at this time. 

Furthermore, it is known that the relative entropy between the probability 
distribution of a Markov process and its corresponding stationary state is a strictly 
decreasing function of time [20]. Hence, D XtP (t) must be a decreasing function, as we 
have obtained in our calculation. However, the relative entropies when only one of the 
variables is taken into account exhibit a richer phenomenology. 

The behavior is rather different in the weakly damped regime than in the strongly 
damped one. In the strongly damped case (a < 1) the relative entropies D XiP (t) 
and D x {t) just decay monotonically with time, see figure (p2a). However, we obtain 
a non-monotonous behavior in the relative entropy of the momentum distribution. This 
can be explained as follows. The equilibrium distribution of the momentum does not 
depend on the frequency of the oscillator. Therefore, at the quench time, the forward 
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(a) (b) 




t 



Figure 3. (a) Relative entropies D XtP , D x and D p as a function of time t after the 
quench in the strongly damped regime (a < 1): friction dominates inertia. The relative 
entropies D x ^ p and D x decay monotonically and almost coincide, while D p is very small 
and goes through a rise-and-fall. (b) Relative entropies D xp , D x and D p as a function 
of time t in the underdamped regime. Inertia dominates friction (a > 1) resulting in 
an oscillatory out of phase decay of the relative entropies D x and D p . Note that in 
both cases (a) and (b), the position captures the full information on (Wdiss) a t t = 0. 



and backward momentum distributions are identical. However, once the potential is 
quenched, the potential energy is not at equilibrium and as a consequence the kinetic 
energy momentum distribution will depart from equilibrium to relax back to the same 
distribution at a later time. As a consequence D p (t) increases from D p (0) = 0, reaches 
a maximum and decays back to zero for long time, as can be seen in the inset of figure 
([3j a). The maximum is however very low, since damping is strong. 

We can see a more pronounced and interesting effect in the underdamped case 
(a > 1). The main results are represented in figure (IHJb). Note the oscillatory exchange 
of information on dissipation between the position and velocity variables and the decay 
of the total information contained in D XjP (t). In particular all the available information 
about the dissipation is periodically contained in one of the single variables, x or p, and 
it dies out (it gets lost in the bath degrees of freedom) as time evolves. 

The peculiarities observed in the right figure (pflb) can be better understood by 
rewriting the relative entropy in fl50l) as follows: 

D x , p {t) = D x (t) + D p (t) + i In (y^) » ( 53 ) 
where the correlation coefficient r t is given by 

_ {xp) 2 t , , 

n ~ FW>? (54) 

Since < r t < 1, we first note that the last term in the r.h.s of equation (1531) is always 
positive, hence: 

D XjP (t)>D x (t)+D p (t). (55) 
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We conclude that, in the present case, the sum of information on the dissipation gathered 
separately from position and momentum is smaller than that from both variables taken 
together. The equality sign in ( 155]) is realized when r t = 0, or (xp) t = 0. Since 
the variables are Gaussian, the condition of zero correlation is tantamount to the 
independency of position and momentum. From the oscillating analogue of expression 
f H5|) . one easily verifies that this occurs at specific times t = where v = ^\fc 2 — 1. 

Another feature is that one of the variables, either x or p, loses all information on 
dissipation at another set of specific times. From equations ( 15TI) and ( 1521) one finds that 
this occurs if (x 2 ) t = (x 2 ) or (p 2 )t = (p 2 ) respectively. This is in agreement with the 
more general observation that the relative entropy of a specific degree of freedom is zero, 
when, at a given time, the detailed balance condition holds (i.e., when at that time the 
forward and backward distributions are equal). 

We conclude that, on the whole, an intricate transfer of information on dissipation is 
taken place between position and momentum of the underdamped Brownian particle. At 
the same time, the information on the dissipated work is irreversibly lost by the punctual 
(one-time) relative entropy of x and p and transfered to the heat bath variables as time 
goes by. 



5. Two coupled oscillators: flow of information on dissipation 

To complete the picture, we next consider the case of a harmonically bound Brownian 
particle that is coupled, via a second Brownian particle, to the heat bath. The idea is 
that by monitoring this second particle, we are including some information on the heat 
bath (of which it is supposed to be part). 

The Langevin equations of motion that describe the system read: 

mil = —mto 2 (t)xi — K{x\ — x 2 ), (56) 

mx 2 = -mujQX 2 - K(x 2 - xi) + £(£) - \x 2l (57) 

= 2XT6(t -If). (58) 

Again we consider the quench experiment. For times t < 0, the oscillator under 
consideration, oscillator 1, is initially at equilibrium with ujq. At t = we perform 
an instantaneous quench switching so that u(t) = u)\ for t > 0. Oscillator 2 is kept 
throughout at the same frequency w , while, on one hand, linearly coupled to oscillator 
1 with a strength K and, on the other hand, immersed in the heat bath. The behavior 
of the first moments is trivial: 

( Xl (t)) = ( Pl (t)) = (x 2 (t)) = (p 2 (t)) = 0. (59) 

Furthermore, the probability distributions are all Gaussian so we only need to evaluate 
the second moments. Defining a = K + mw 2 , and (3 = K + mw 2 , they obey the following 
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set of evolution equations: 
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where the matrix A is given by: 



/ 








2/m 























\ 










-2(3 

















2K 









-P 


1/m 














K 






























2/m 






























-2A/m 


-2a 





2K 





















—a 


1/m 


—\/m 


K 




































1/m 


1/m 









K 

















—a 


—X/m 





1/m 















K 








-13 








1/m 




V 








K 








K 





-P 


—a 


—\/m 


J 



(60) 



(61) 



The system can be solved explicitly using the appropriate initial conditions. 
However, the analytic expressions are extremely lengthy. In what follows, we will 
illustrate the obtained behavior via appropriate figures. 



5.1. Relative entropy 

Since the joint distribution is Gaussian (and the backwards density even in p), the 
relative entropy involving all four variables xi,pi, X2 and P2 can be compactly expressed 
in terms of the covariance matrices C4 and C4: 



D 



Xi,pi,X2,P2 



(t) 



In 



'detC 4 



+ Tr^Ck) - 4 



detC 4/ 

The latter are the following four-by-four symmetric matrices 



(62) 



/ (xj) t (xipi) t (xix 2 ) t (xip 2 ) t \ 



(xipi) t 
(xix 2 )t 

V (xm)t 



(pi) t (pix 2 ) t 

(PlX 2 )t (xfjt 

(pm)t (x 2 P2)t 



(PlP2)t 
(x 2 P2)t 
(Pl)t 



(63) 
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Figure 4. (a) Complex behavior of the relative entropies as a function of time for 
oscillator one. We plot the evolution of the total relative entropy of all four variables 
(positions and momenta of both oscillators: xx, Pi, £2, P2), which decays monotonically 
and is always an upper bound with respect to any other relative entropy accounting 
for less degrees of freedom. The relative entropies pertaining to the first oscillator 
(D Xl ^ Pl (t), D Xl (t) and D pi (t)) all oscillate in time in an intricate manner, (b) Same 
picture, but for oscillator two. Since the latter is directly connected to the heat bath, 
the relative entropy D X2jP2 (t) is found to decay faster. 



Regarding the covariance matrix corresponding to the backwards excursion, we explicitly 
find 



aT 





KT 





Kmw'j+(3mwQ 







mT 








KT 










Kmw'^+PrnwQ 













mT 



From the above results, we can derive the relative entropy of all available degrees 
of freedom of the system (both positions X\ and X2, and momenta p\ and P2). While 
these are the pertinent variables to evaluate the dissipated work, when measured along 
the whole time track, a single time measurement as performed here again represents a 
coarse-graining. Only when performed at the moment of the quench does it contain full 
information. When considering times t > 0, information on the dissipation will flow and 
get irreversibly lost to the bath variables. This is similar to the situation discussed in 
the overdamped case 

Similarly to the underdamped oscillator case, one can also explore the behavior of 
the relative entropies of all possible combinations of all 4 degrees of freedom x±, pi, X2 
and p2- Several of such combinations are plotted in figure HI First note that, as explained 
before, the relative entropy of the whole system, D xltPuX2tPl2 (t), decays monotonically in 
time. Then, the relative entropy of oscillator 1, D Xl4>1 (t), is oscillating below the former. 
Both entropies for position and momentum alone, transfer information periodically and 
are modulated by D xltP1 (t). Note that the position of the first oscillator captures the 
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D (t) 

X I>Pl> X 2>P2 

D (t) 

x i>Pi 
D (t) 

2-P 2 





Figure 5. Time evolution of the relative entropies for the whole system, D XltPliX2>P2 (t), 
oscillator one, D Xl ^ Pl (t), and oscillator two, D X2iP2 (t). Each plot shows a different 
behavior as the coupling constant K between the oscillators is changed. This illustrate 
a subtle mechanism of information transfer due to correlations of the degrees of 
freedom. 



whole dissipation at the moment of the quench, 

D X1 (0) = D XUP1 (0) = D X1 , P1 , X2 , P2 (0)- (65) 

The novelty in this case is that oscillator 1 is not directly in contact with the 
heat bath, but rather to oscillator 2, whose relative entropies we now comment on. 
First, we see that the relative entropies are significantly smaller than those in oscillator 
1. Oscillator 2 receives the information on the dissipated work from the quench only 
indirectly through its coupling to 1. Furthermore, while it "bounces" back some of this 
information to 1 it also irreversibly loses information to the bath variables. 

Regarding the plateau for the relative entropy appearing at short times in figure 
01]), one observes that most of the effect of the dissipative process still resides inside the 
system formed by the two particles. In fact, oscillator 1 keeps much of this information 
while slowly transferring it to oscillator 2. Some of it can come back but a part of it is 
lost to the heat bath. This behavior is illustrated in figure ([5]) by varying the coupling 
constant K that connects both oscillators. Note that for K = 5, the relative entropy of 
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oscillator 2 is almost zero but yet there is a considerable difference between D XltPuX2)P2 (t) 
and D xljP1 (t). Therefore, while oscillator 2 is "close to equilibrium", its correlation with 
oscillator 1 still carries relevant information on the irreversible quench. 

6. Conclusions 

We have derived a microscopically exact expression for the dissipative work along an 
arbitrary process starting in equilibrium for systems described by stochastic dynamics. 
As was anticipated in earlier work in the literature, we find that dissipation is 
proportional to the relative entropy between the probability distributions of forward 
and backward trajectories, respectively. In other words, dissipation is related to our 
ability to distinguish the arrow of time. Furthermore, the expression in terms of relative 
entropy gives rise to lower bounds if only partial information on the trajectories is 
available. 

In combination with Crook's theorem [2U HE], we have shown that a single 
functional of the path, namely the work itself, provides an exact and full assessment 
of dissipation. In other words, work "exhausts" the arrow of time: if we know the 
statistical properties of the work done along the forward and the backward process, no 
further information can help us to better distinguish between the two. 

We have discussed various scenarios to illustrate how dissipation can be bounded 
from below on the basis of reduced information. First, when the information about 
the continuous trajectory of the system is reduced to a finite number of measurements, 
our analysis has shown that the resulting relative entropy provides reasonably accurate 
bounds for the dissipation, even with only a small number of intermediate measurement 
points. This result could be specially useful in real experiments where trajectories are 
recorded at finite sampling rates. Second, we have analyzed the effect of considering a 
subset of variables instead of a detailed description of the system in a quench process. 
In this case, the time-arrow information, concentrated in the single position variable 
immediately after the quench, is subsequently transferred to the thermal bath and the 
other variables. Of special interest is the case of two oscillators, the first one undergoing 
a quench of its frequency and the second one in contact with a thermal bath. One would 
expect that the information contained in the first oscillator would be transferred to the 
second one before getting lost in the thermal bath. However, our analysis calls into 
question this naive picture, as we have shown that the oscillator coupled to the thermal 
bath is the first to thermalize. This result indicates that "reversibility" is transferred 
from the thermal bath to the quench point, instead of "irreversibility" being transferred 
in the opposite direction. The generalization of our analysis to long chains of oscillators 
will help to further elucidate this issue. 
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p(xi+\, t + Atlxi, t) = -. exp 



(67) 



T(ln^^J = (AV)-AF, (61 



Appendix 

We studied the effect of coarse-graining in time for the harmonic potential. However, 
the same procedure can be applied for an arbitrary potential, at least in the limit of a 
infinitely large number n of time measurements. Indeed the Gaussian ansatz remains 
valid for any potential for for short time increments, since the propagator of the Fokker- 
Planck equation is then always Gaussian [45J. Therefore, equations (1221) and (1231) are 
completely general in this case. The only difference is the expression for the first and 
second moments, but even this we know, since 

x i+1 {U + At) = x^U) - V'( Xi , U)At + iit^At 1 ' 2 + O ((At) 2 ) . (66) 

On the whole, for small At, the Fokker-Planck equation of such transition probabilities 
can be solved giving rise to [4~6] 

(x i+1 -Xi + V'(xi,t)Atf ~ 
AT At 

Now we recall equation (1211) . and we find that the first term in the r.h.s. gives 

eq 
Pi 

where AV = V(xf,tf) — V(x ,t ). After substitution of the conditional probabilities 
and some algebra, the second term in the r.h.s. of ( [211) yields to 

Tj:(^ P ^^)^(UA + B)), (69) 

i=0 \ P\ x i\ x i+V I i=o 

where 

a _ ,\A x i+i - x i) [V'(x i+1 ,t i+1 ) + V'(xi,ti)} 

A - -At — - , (70) 

Remember that this result is valid for small At, or conversely, for big n. In the limit of 
n — > oo, we find to lowest order in At that A = —At xV'(x, t) and B = 0, hence: 

ra-l r t f 

lim Y (A + B) = - / dtxV'ix, t). (72) 

The last integral is the heat Q associated to a specific stochastic trajectory, cf. Eq. 
(j!5p . Then, relations (|2ip . (1681) . (169|) and (172|) . together with the conservation of energy, 
imply that 

I n ->oo = (AV) — AF + (Q) = (W) — AF = (W diss ). (73) 
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This is a pedestrian path integral method to show that, for a general time dependent 
potential, the relative entropy of the distributions of the forward and backward paths 
(considering also their initial ensemble probabilities) is equal to the dissipated work. 
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